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PORTABLE BROWSER DEVICE WITH ADAPTIVE PERSONALIZATION 
CAPABILITY 

Claude-Nicolas Fiechter 
5 Amir Ben-Efraim 

Tea Hea Nahm 
David Hudson 

CROSS REFERENCE TO RELATED APPLICATION 

10 

This application is a continuation-in-part of co-pending U.S. Patent 
Application Serial No. 09/415,295, entitled "Portable Browser Device With Voice 
Recognition And Feedback Capability," (hereafter "the '295 application"), filed 
October 8, 1999, which application is assigned to the assignee of the present invention 
15 and is hereby incorporated herein by reference in its entirety. 



BACKGROUND OF THE INVENTION 

A number of different information networks are available that allow access to 
information contained on their computers, with the Internet being one that is generally 
known to the public. While the Internet is used herein as an example of how the 
20 present invention is utilized, it is important to recognize that the present invention is 
also applicable to other information networks. A brief overview of concepts 
associated the world-wide web, web servers, and web browsers that are pertinent to 
understanding the present invention is presented here. 

An example of a typical Internet connection found in the prior art is shown in 
25 Fig. 1. A user that wishes to access information on the Internet typically has a 

computer workstation 112 that executes an application program known as browser 
114. Workstation 112 establishes a communication link 116 with web server 118 
such as a dial-up wired connection with a modem, a direct link such as a Tl or ISDN 
line, or a wireless connection through a cellular or satellite network. When the user 
30 enters a request for information by entering commands in browser 1 14, workstation 
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112 sends a request for information, such as a search for documents pertaining to a 
specified topic, or a specific web page to web server 118. Each web server 118, 120, 
122, 124 on the Internet has a known address which the user must supply to the 
browser 114 in order to connect to the appropriate web server 118, 120, 122, or 124. 
5 If the information is not available on the user's web server 1 18, a central link such as 
backbone 126 allows web servers 120, 122, 124 to communicate with server 118 to 
supply the requested information. Because web servers 118, 120, 122, 124 can 
contain more than one web page, the user will also specify in the address which 
particular web page he wants to view. The web servers 118, 120, 122, 124 execute a 
10 web server application program which monitors requests, services requests for the 
information on that particular web server, and transmits the information to the user's 
workstation 112. 

In the prior art, a web page is primarily visual data that is intended to be 
displayed on the display device, such as the monitor of user's workstation 1 12. When 

15 web server 118 receives a web page request, it will transmit a document, generally 
written in a markup language such as hypertext markup language (HTML), across 
communication link 116 to the requesting browser 114. Communication link 116 
may be one or a combination of different data transmission systems, such as a direct 
dial-up modem connected to a telephone line, dedicated high-speed data links such as 

20 Tl or ISDN lines, and even wireless networks which transmit information via satellite 
or cellular networks. 

When web server 118 receives a search request, the request is sent to the 
server containing the search engine specified by the user. The search engine then 
compiles one or more pages containing a list of links to web pages on other web 
25 servers 120, 122, 124 that may contain information relevant to the user's request. The 
search engine transmits the page(s) in markup language back to the requesting web 
server. This entire system of web pages with links to other web pages on other 
servers across the world is known as the "World Wide Web". 

As the capabilities, usefulness, and amount of information available on the 
30 Internet increases, it is desirable to have the ability to access the Internet from any 
location at any time. One known solution is to use wireless mobile communication 
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systems with portable devices such as laptop or palmtop computers. The user enters 
commands and requests using a keyboard or other known data entry device. The 
results of the request/command are then output to the device's display. The wireless 
system transfers data between the server and the user's portable device while the user 
5 is free to move about an area. 

There are situations, however, when it would be more convenient for the user 
to enter commands and requests orally without being required to enter the information 
through a keyboard or other entry device, and to receive the information verbally 
without looking at a display for the results. 

10 Systems known in the prior art are capable of providing embedded 

microprocessor systems that respond to a verbal request such as providing audio 
^ readout of sensed data, such as vehicles that include audio output of RPM, fuel level, 

mileage rate, ambient air temperature, and navigation instructions to a destination. It 
is also known that systems are being developed that are capable of delivering audio 

15 information in response to a user's verbal request to retrieve e-mail from an Internet 
account, or other information from subscription news services. 

The system disclosed in the '295 application allows a user to customize 
information preferences ahead of time, and is capable of browsing virtually any 
address on an information network such as the Internet. The system in the '295 

20 application is also capable of outputting information that arrives from an information 
network in markup language or speech format. A user on the system typically sets up 
one or more categories of information to be received, such as news, sports, and 
weather. One or more subcategories may be listed for each category. For example, 
the news category may have a list of news sites from which information is to be 

25 received. Currently, the user can interactively, through audio commands or 

commands entered through a manual data input device, rearrange the order of the 
categories, as well as the order of the subcategories within categories, from which 
information is received. 

A search engine generates a playlist based on the information available in the 
30 categories and subcategories, and from the other sources specified by the user. In 
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some situations, a user may be interested in regularly receiving information on an 
array of topics in the order in which the categories, subcategories, and other sources 
of information are arranged. In other situations, a user may wish to have the playlist 
modified according to their preferences without being required to reprogram the list of 
5 categories, subcategories, and other user-specified sources of information. It is 
therefore desirable to provide a system that presents a brief headline for the 
categories, subcategories, and each piece of information. It is also desirable for the 
system to allow users to skip over categories, subcategories, and individual pieces of 
information after hearing the headline or any portion of the content. It is further 
10 desirable to provide a system that monitors the user's actions, and modifies the 

playlist based on the user's previous actions. The system would thus determine which 
information to present and re-prioritize the order in which information is presented 
based on how interested the user appeared to be in the information during previous 
sessions. 

15 SUMMARY OF THE INVENTION 

A mobile information network browser device with audio feedback and 
adaptive personalization capability that is capable of transmitting a request for 
information via a wireless communication interface from one or more servers in an 
information network. The browser device further includes an audio interface capable 

20 of receiving data from the wireless communication interface that is responsive to the 
request for information. The browser device interfaces with a wireless 
communication network so that it may be used in a mobile vehicle, such as an 
automobile. The requested information that is presented and the order in which it is 
presented to the user is determined based on indicators of the user's interest in a topic 

25 during previous sessions. Such indicators can include whether the user input a 
command to skip, fast-forward, rewind, or request more detail about a category, 
subcategory, or topic of information. The adaptive personalization capability can also 
prevent redundant content from being presented. 

In one embodiment, a mobile browser system with adaptive personalization 
30 and audio feedback capability for retrieving information from an information network 
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is provided. The browser system includes a wireless communication interface that 
transmits data to one or more of the plurality of network servers, receives user input, 
and receives data from one or more of the plurality of network servers. The data 
transmitted to the network servers includes a request for information, and the data 
5 received from the includes information responsive to the request. The browser system 
also includes an audio interface operable to receive data from the wireless 
communication interface. 

The browser device also includes an adaptive personalization module that 
monitors the user input during sessions with the browser system, and determines the 

10 order for presenting the requested information based on previous user input. A user's 
model is updated based on the previous user input and the model is used to determine 
whether a piece of content is presented and the order for presenting each piece of 
content in the requested information. User actions such as skipping playback, fast- 
forwarding or rewinding playback, and requesting more detail on the requested 

15 information, are monitored to determine a user's interest in the topic of the story. 

The adaptive personalization module also generates a representation of each 
piece of content in the requested information, and determines the order of presentation 
of the requested information based on the user's model and the representation. The 
adaptive personalization module further determines whether the requested information 
20 is redundant compared to information presented during a previous session and 
compared to one or more other pieces of content in the requested information. 

In another embodiment, a method for browsing an information network via a 
wireless communication network and receiving responsive information in audio 
format using a mobile audio device, is provided. The method includes: 
25 transmitting input from a user via the wireless communication network to a 

data processor; 

processing the input to determine when the user enters a valid browsing 
command; 

transmitting the browsing command to a server on the information network; 
30 receiving the responsive information from the server; 
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adaptively determining the order for presenting the responsive information 
based on user input during one or more previous sessions with the 
mobile audio device; 

formatting the responsive information in audio format; 
5 transmitting the formatted audio information to the mobile audio device via 

the wireless communication network; 

generating an audio output signal in the mobile audio device; and 

transmitting the audio output signal to an audio output device. 

Adaptively determining the order for presenting the responsive information 
10 can include updating a user's model based on the previous user input, and determining 
the order for presenting the responsive information based on the user's model. Input 
that is monitored includes skipping, fast-forwarding, rewinding, and requesting more 
detail for a particular piece of content in the responsive information. 

The topic of a piece of content is determined by generating a representation, 
15 such as a "bag of words." The order of presentation of each piece of content in the 
responsive information is determined based on the user's model and the 
representation, which indicates the topic of the content. 

The device and method of the present invention thus allows users to skip over 
categories, subcategories, and individual pieces of information after hearing the 

20 headline or any portion of the content. The user's actions are automatically 
monitored, and the playlist can be modified automatically based on the user's 
previous actions. The information to be presented and the order in which it is 
presented is thus based on how interested the user appeared to be in the information 
during previous sessions. Redundant information is also reduced based on the topics 

25 of the pieces of content, as well as topics presented to the user during previous 
sessions. Relevant information is thus presented to the user in the order of most 
interest without requiring the user to explicitly re-prioritize topics or delete redundant 
content. 
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The foregoing has outlined rather broadly the objects, features, and technical 
advantages of the present invention so that the detailed description of the invention 
that follows may be better understood. 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 Figure 1 is a block diagram of a system for accessing an information network 

found in the prior art. 

Figure 2 is a diagram of one embodiment of a system for accessing an 
information network in accordance with the present invention. 

Figure 2a is an example of a user interface for modifying a playlist. 

10 Figure 3a is a flowchart diagram of logic for handling user input in a mobile 

audio device in accordance with the present invention. 

Figure 3b is a flowchart diagram of logic in a mobile audio device for 
handling information requested from an information network in accordance with the 
present invention. 

15 Figure 4 is a flowchart diagram of logic in a voice interaction system for 

accessing an information network in accordance with the present invention. 

Figure 5 is a flowchart diagram of logic for entering personal information in a 
personalization server in accordance with the present invention. 

Figure 5a is a flowchart diagram of logic for adaptively personalizing a user's 
20 model in accordance with the present invention. 

Figure 5b is a flowchart diagram of logic for determining the content to be 
presented and the presentation order of the context in accordance with the present 
invention. 

Figure 6 is a flowchart diagram of logic for retrieving information from a 
25 content server in accordance with the present invention. 
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Figure 7 is a block diagram of one embodiment of a mobile audio device in 
accordance with the present invention. 

Figure 8 is a block diagram of a voice recognition system for accessing an 
information network as found in the prior art. 

5 Figure 9 is a diagram of another embodiment of a system for accessing an 

information network in accordance with the present invention. 

Figure 10 is a block diagram of another embodiment of a mobile audio device 
in accordance with the present invention. 

Figure 11 is a schematic diagram of components included in one embodiment 
10 of the present invention for a mobile audio browsing device. 

The present invention may be better understood, and its numerous objects, 
features, and advantages made apparent to those skilled in the art by referencing the 
accompanying drawings. The use of the same reference symbols in different drawings 
indicates similar or identical items. 

15 DETAILED DESCRIPTION 

The method and apparatus of the present invention is applicable to mobile and 
portable devices that are capable of accessing a computerized information network. 
The present invention provides a mobile device that allows the user to access an 
information network while the user is mobile, to request information using voice 
20 commands, and to receive information responsive to the request in audio format. The 
present invention thereby alleviates the need for the user to divert his or her attention 
to enter requests for information using a keyboard or other device, or to view a 
display to read the information returned as a result of the request. 

Fig. 2 shows an embodiment of the present invention for a mobile information 
25 network browser system 200 with voice recognition and feedback capability, and 
adaptive personalization. Browser system 200 includes wireless communication 
network 202, voice interaction system (VIS) 204, and mobile audio device 208, 
content server 210, personalization server 212, remote servers 214, information 
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network 216, conventional telephone system 218, cellular telephone system 220, and 
workstation 222. VIS 204 incorporates a voice recognition system that deciphers a 
user's voice input and recognizes when a user inputs a browser command. 

There are a number of alternatives for providing a user interface for 
5 controlling information network browser 1 14 and retrieving information from the 
information system 216 that may be utilized with the present invention. In one 
embodiment, content server 210 incorporates VIS 204 and voice navigation 
commands that are transmitted to and executed by content server 210. In another 
embodiment, VIS 204 is a separate system that resides outside of any of the other 
10 components of mobile information network browser system 200. In another 

embodiment, VIS 204 is built into a component of wireless communication network 
202 such as cellular telephone system 220, and transmits commands to content server 
210, which executes the command. In another embodiment, mobile audio device 208 
includes VIS 204 and transmits recognized commands to content server 210. 

15 Browser 114 performs functions including navigation and data output. 

Navigation determines what information the user is interested in retrieving. Data 
output presents the retrieved information in a legible and/or audible format to the user. 
In the present invention, the output is usually audible. However, another embodiment 
of the present invention includes the capability to additionally output the responsive 

20 information to a display monitor, text file, printer, and/or facsimile device. In an 

embodiment of the present invention wherein mobile audio device 208 includes voice 
recognition, mobile audio device 208 also performs navigation functions of browser 
1 14 to determine which commands to send to content server 210 to retrieve the 
requested information. In this embodiment, control switches, such as buttons and 

25 dials, are provided to allow the user to enter navigation commands and browser 

control selections. Control switch selections are converted to information requests or 
browser controls by program instructions in mobile audio device 208 and transmitted 
as commands to content server 210 via wireless communication network 202. 

It is important to note that a user's listening preferences and requests may be 
30 preprogrammed, or set to default values, and therefore user input is not required for 
the present invention to request information from information network 216. The user 
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may, however, override preprogrammed and default requests and settings using voice 
input. The user may also provide voice input to reset information requests to default 
values and/or to request information in addition to the information requested by the 
preprogrammed or default settings. As used herein, the term "requested information" 
5 pertains to information that is requested by mobile audio device 208, whether the 
request is the result of user input or preselected/default settings for mobile audio 
device 208. 

Referring to Figs 2 and 2a, Fig. 2a shows an example of a user interface for 
allowing the user to customize their playlist 250 from a device with a display, such as 

10 workstation 222 (Fig. 2). It should be noted, however, that the user may also enter 
preferences using other interface means such as conventional telephone system 218 or 
cellular telephone system 220 through information network 216. A playlist 250 is 
stored in a user model in personalization server 212 for each user. The playlist 250 
includes one or more sources of information the user wants to access. A location, or 

15 address, in information network 1 10 (Fig. 1) is associated with each source of 
information in playlist 250 in the user's model. The addresses can correspond to 
sources of information that are accessible with or without a subscription or user fee. 
When a fee is required to access a particular source of information, a user login name 
and/or password is also associated with the source of information in the user's model. 

20 Playlist 250 includes categories, such as, for example, "news" category 252, 

"finance" category 254, "stocks" category 254, "email" category 256, "sports 
headlines" category 258, and "weather" category 260. Other categories may be 
included in the list in addition to, or instead of, those shown in Fig. 2a. A category 
may include one or more subcategories. For example, "news" category 252 is shown 

25 including four subcategories, namely, CNN News, BBC News, NPR News, and 
Yahoo News AP. The order in which information in the subcategories is presented 
can be changed by selecting a corresponding reorder option, such as reorder option 
264 for the "news" category 252. The reorder option allows the user to put one or 
more subcategories ahead of or behind other subcategories. The list of subcategories 

30 may be edited by selecting a corresponding edit option, such as edit option 266, to 
remove and/or insert subcategories. The reorder option and edit option are shown as 
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examples of ways for a user to personalize playlist 250. Other mechanisms and 
options for personalizing playlist 250 may be included in addition to, or instead of, 
those shown in Fig. 2a. These other mechanisms and options include voice command 
interfaces. 

5 Another alternative for modifying playlist 250 is to adaptively personalize 

playlist 250 based on the user's actions during previous sessions with mobile audio 
device 208. Fig. 2a shows enable/disable adaptive personalization option 268 as an 
example of a mechanism that allows the user to enable and disable the adaptive 
personalization feature of personalization server 212 (Fig. 2). Other mechanisms and 
10 interfaces for enabling and disabling adaptive personalization option 268 can be 

included in addition to, or instead of, a graphical user interface as shown in Fig. 2a. 
These other mechanisms and interfaces include voice command interfaces. The 
functions performed when adaptive personalization is enabled or disabled are further 
discussed hereinbelow in connection with the discussion of Figs. 5 and 5a. 

15 Fig. 3a shows a flowchart of one embodiment of logic that may be used in 

mobile audio device 208 for handling input from a user to browse information 
available from information network 216. Referring now to Figs. 2 and 3a, program 
instructions associated with mobile audio device 208 wait for input from a user as 
shown at block 302. When input is received, mobile audio device 208 stops 

20 outputting information from previous requests (if applicable), as shown at block 304. 
When mobile audio device 208 includes voice recognition capability (as shown by 
dashed box 306), it processes the user's speech to determine whether a valid 
command was entered and converts the analog signal to digital samples of the analog 
signal at a prescribed rate as shown in block 308 to generate a processed signal 

25 representing the user's voice input. Mobile audio device 208 may also include 

capability to compress and/or encrypt the digital samples of the user's input as shown 
in block 310, using one of any known compression and/or encryption algorithms. The 
processed signal representing the user's input is output to wireless communication 
network 202 as shown in block 312. Wireless communicate network 202 then 

30 transmits the processed signal to VIS 204 as shown in block 3 14. Once the user input 
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signals are transmitted, the program instructions loop back to block 302 and wait for 
more input from the user. 

Referring now to Figs. 2 and 3b, Fig. 3b shows a flowchart of one 
embodiment of logic that may be used in mobile audio device 208 for providing 
5 requested information from servers 210, 212, 214 in the form of audio output to the 
user. Information responsive to a user's request is transmitted from servers 210, 212, 
214 to VIS 204. As shown in block 320, VIS 204 transmits the information in an 
appropriate format to mobile audio device 208 via wireless communication network 
202. Logic contained in program instructions in mobile audio device 208 suspend 
[°~ 10 execution of further program instructions related to processing responsive information 
% 4 until the responsive information is received, as shown in block 322. As the 

,1 responsive information is received, it is buffered, or stored, as shown in block 324, 

*' until it is requested for data processing. Mobile audio device 208 is capable of 

II processing data at a rate that minimizes discontinuity or interruptions in outputting 

i 15 the information to audio output devices. When the responsive information is 
H compressed and/or encrypted, it is correspondingly decompressed and/or decrypted in 

± mobile audio device 208 as shown in block 326. The responsive information 

% comprising textual data is then translated from text to speech, and then transmitted to 

an audio output device as shown in blocks 328 and 332. Responsive information 
20 comprising digital voice data is converted from digital to analog signals which are 

then transmitted to an audio output device as shown in blocks 330 and 332. Once the 
analog audio output signals are transmitted, the program instructions loop back to 
block 322 and wait for data from VIS 204. 

Referring now to Figs. 2 and 4, Fig. 4 shows a flowchart 400 of one 
25 embodiment of logic that is used in VIS 204. The logic is implemented in program 
instructions that are executed to allow a user to log in and enter personal information 
in personalization server 212, recognize voice commands, transmit the appropriate 
data selections and navigation commands to content server 210, receive responsive 
information from content server 210, and transmit the responsive information to 
30 mobile audio device 208 via wireless communication network 202. As shown in 
block 402, mobile audio device 208 transmits user input to VIS 204 via wireless 
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communication network 202. Logic contained in program instructions in VIS 204 
suspends execution of further program instructions related to processing user input 
until the user input is received, as shown in block 404. As the user input is received, 
it is translated from voice to an input signal in block 406. 

5 In Block 408, the input signal is analyzed to determine what action the user 

wants browser system 200 to perform. A copy of the input signal is also stored in a 
log of user actions, as shown in block 408. The log is available to personalization 
server 212 to use in adaptively personalizing the user's playlist based on actions taken 
by the user, as further described herein. The appropriate program instructions are 

10 then executed corresponding to the input by the user as follows. When a user first 
accesses VIS 204, the system verifies that the user is authorized to access the system. 
This may be accomplished in one of several known ways. In one embodiment, each 
user is assigned a password which must be entered and verified before access to the 
system is granted. One example of an implementation for verifying a user's password 

15 is shown in blocks 410 through 416. Specifically, on first access, the user's password 
is retrieved from personalization server 212 as shown in block 410, and compared to 
the password entered by the user, as shown in block 412. If the user's input matches 
the retrieved password, the user is successfully logged in and control passes from 
block 414 back to block 408 to request the user's main menu. Note that control is 

20 passed to block 408 on the first access to retrieve the main menu, whether it is a user's 
customized menu or a default menu. If the passwords do not match, a login error is 
issued as shown in block 416, and a notice can be output to inform the user that the 
login was not successful. Optionally, the user may be prompted again, up to a 
predetermined number of times, to enter a password. 

25 Once control passes to block 418, the user's personalized menu is retrieved 

from personalization server 212, and stored in memory as shown in block 420. 
Program instructions, corresponding to block 422 and 424, translate the stored menu 
from text data to digital voice data. The digital voice data is then compressed and/or 
encrypted in block 426 and transmitted to mobile audio device 208 via wireless 

30 communication network 202 as shown in block 428. Once the digital data is 

transmitted, control is passed to block 404 to wait for input from the user. Control is 
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passed to block 418 whenever the user inputs a menu request for either the main menu 
or one of a variety of sub-menus, which the user may also personalize. 

When the user enters a request for information, control is passed from block 
408 to block 430, wherein VIS 204 issues a request for information to content server 
5 210. The requested information is retrieved from content server 210, or from servers 
214 if the requested information does not reside on content server 210. The requested 
information, also referred to as content, may be stored by VIS 204 for subsequent 
access without requiring another request for the content from content server 210, as 
indicated by block 432. Program instructions, corresponding to blocks 422 and 424, 
10 translate the requested information from text data to digital voice data. The digital 
voice data is then compressed and/or encrypted in block 426 and transmitted to 
mobile audio device 208 via wireless communication network 202 as shown in block 
428. Once the digital data is transmitted, control is passed to block 404 to wait for 
input from the user. 

15 Referring now to Figs. 2 and 5, Fig. 5 shows personalization logic 500 

implemented in program instructions on personalization server 212. Program 
instructions corresponding to block 502 suspend execution of further program 
instructions to access personal information until a request is received from VIS 204. 
Once a request is received, program instructions access a database of user information 

20 as shown in block 504. The user's information and personalized settings, also 

referred to as the user's model, are retrieved from the database by indexing through 
the information based on the user's identification as shown in blocks 506 and 508. 

The user's model is updated using adaptive personalization logic, as 
represented by block 510, in accordance with the present invention. Fig. 5a shows 

25 one embodiment of processes performed by adaptive personalization logic when 

adaptive personalization option 268 (Fig. 2a) is enabled as well as when it is disabled. 
When adaptive personalization option 268 is disabled, the user's default model is 
restored, as indicated by block 514. The term "default model" refers to the model that 
was being used before the adaptive personalization option 268 was enabled. The user 

30 can also be provided with the option of choosing between two or more default 
models, if more than one previously used model is available. 
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When adaptive personalization option 268 is enabled, block 518 indicates that 
the user's log is retrieved from VIS 204 (Fig. 2). The user's log includes a record of 
all actions and commands issued by the user while interacting with browser system 
200 (Fig. 2), along with a record of the category, subcategory, and topic of the content 
5 that was being played back when the action was taken or the command was issued. 
Playback of content can be preceded by an announcement of a headline or summary 
of each piece of content. Such actions and commands include, for example, fast- 
forwarding through a headline or through the content, skipping categories, 
subcategories, or individual pieces of content, and asking for additional information 
10 on a particular category, subcategory, or piece of content. Adaptive personalization 
logic infers the user's level of interest in a particular category, subcategory, or piece of 
content based on the user's interaction with browser system 200 while a headline or a 
piece of content is being played back. 

The user's default model is used as a baseline to determine the user's relative 
15 interest in categories, subcategories, and topics. Adaptive personalization logic 

modifies the default user's model based on actions taken while a user was receiving 
information in a particular category, subcategory, and topic. The modifications can 
include reordering, deleting, and/or inserting categories, subcategories, and individual 
pieces of content based on the user's level of interest in the category, subcategory, 
20 and/or topic of the content. The adaptive personalization logic also determines 

whether content is redundant, and determines which of several pieces on content on a 
particular topic should be presented. 

For example, referring to Fig. 2a, if a user fast-forwards or skips the news 
category 252 and the finance category 254 to get to the stocks category 256, then 

25 more priority will be given to the stocks category 256 in the future. This change in 
priority can result in rearranging the order in which the categories and/or 
subcategories are presented so that the stocks category 256 is presented before the 
news category 252 or the finance category 254. The threshold for determining when 
to modify the user model can be based on a variety of factors including the number of 

30 times the user skipped or only listened to a portion of a piece of content before fast- 
forwarding to the next topic, subcategory, or category. Another factor that can be 
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used as a threshold for determining when to modify the user model includes the 
amount, or percentage, of information in a category, subcategory, or piece of content, 
that was presented before the user skipped to the next category, subcategory, or piece 
of content. The adaptive personalization logic also determines whether any of the 
5 content is redundant to determine which content will be presented as well as the order 
in which it will be presented. The redundancy factor is based on whether and how 
much of the content to be presented pertains to the same topic. The redundancy factor 
can also eliminate repetitive content or weight the priority for presenting it be based 
on whether content pertaining to the same topic was presented during a recent session. 
10 The factors are then used to weight each category, subcategory, topic, and/or piece of 
content. 

An example of one implementation of such logic for adaptively personalizing 
the user's model is shown in Fig. 5a in blocks 518 through 530. In block 518, the 
logic determines whether the user skipped over any categories, subcategories, and/or 

15 topics in previous sessions. If so, logic in block 520 can change the weight, or 
priority, of the category, subcategory, and/or topic based on some predetermined 
threshold. The threshold can be based on criteria such as the number of times the 
category, subcategory, and/or topic was skipped, and/or, the percentage of the 
category, subcategory, and/or topic that was skipped. Note that the priority is 

20 typically lowered for a category, subcategory, or topic is skipped, and the change in 
priority can be proportional to the amount that is skipped. 

In block 522, the logic determines whether the user requested more 
information for a particular category, subcategory, and/or topic in previous sessions. 
If so, logic in block 524 can change the weight, or priority, of the category, 
25 subcategory, and/or topic based on some predetermined threshold. The threshold can 
be based on criteria such as the number of times additional information for the 
category, subcategory, and/or topic was requested. Note that the priority is typically 
raised for a category, subcategory, or topic for which the user requests more 
information. 

30 In block 526, the logic determines whether the user fast-forwarded or rewound 

playback of information in any categories, subcategories, and/or topics in previous 
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sessions. If so, logic in block 528 can change the weight, or priority, of the category, 
subcategory, and/or topic based on some predetermined threshold. The threshold can 
be based on criteria such as the number of times the category, subcategory, and/or 
topic was fast-forwarded or rewound, and/or, the percentage of the category, 
5 subcategory, and/or topic that was fast-forwarded or rewound. Note that the priority 
is typically lowered when a user fast-forwards through a category, subcategory, or 
topic, and raised when a user rewinds a category, subcategory, or topic. The change 
in priority can be proportional to the amount that is fast-forwarded or rewound. 

Fig. 5b shows a flowchart representing processes that can be included in VIS 
10 204, personalization server 212, or content server 210 to determine which content gets 
presented and the order in which it is presented to the user once the user's model is 
provided. In block 550, representations of the requested information that was 
gathered by content server 210 are retrieved. Generation of the representations is 
further described hereinbelow in connection with the discussion of Fig. 6. In block 
15 552, the content to be presented is determined, and each piece of content to be 

presented is ranked based on its category, subcategory, and/or topic and the associated 
priorities from the user's model. The information is ordered so that it is presented to 
the user based on the priorities available in the user's model. 

Referring back to Fig. 5, once the user's model is generated, control is passed 
20 to block 502 to wait for another request for a user' s model. The user's model can be 
accessed by VIS 204 and content server 210. Note that, depending on the 
implementation, some or all of the personalization program instructions in 
personalization server 212 can be implemented in mobile audio device 208, in VIS 
204, and/or in content server 210 to tailor information requests and playback of the 
25 responsive information. 

Referring now to Figs. 2 and 6, logic implemented in program instructions for 
accessing information on content server 210 and remote servers 214, if necessary, is 
shown in Fig. 6. Program instructions corresponding to block 602 suspend execution 
of further program instructions to access information on servers 210, 214 until a 
30 request is received from VIS 204. Once a request for information is received, a check 
is made in block 604 to determine whether the information requested is found on 
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content server's 210 database. If so, the information is retrieved from the database as 
shown in block 606. If not, program instructions on content server 210 issue a search 
for the information on remote servers 214 through information network 216, as shown 
in block 608. The information is retrieved from one or more servers 214, translated 
5 from a markup language, such as HTML, to text, as shown in blocks 610 and 612. 

As indicated in block 613, the textual content is analyzed and distilled into a 
linguistic representation to determine one or more topics to which the piece of content 
pertains. One commonly used linguistic representation of textual content known in 
the art is the "bag of words" representation. In this approach, the content is 

10 represented as a list of the words that appear in it and as a vector of features, with a 
specific frequency assigned to each feature. In some cases the words are stemmed so 
that similar words map to a common root. For instance "learning", "learned", and 
"learns" would all map to the common root "learn". This frequency corresponds to 
the number of times each stemmed word occurs in the document. One or more topics 

15 to which the content pertains is determined by analyzing which words occur most 
frequently. Developing a user model and the bag-of-words representation to 
categorize text and decide how interesting a piece of information will be to a user is 
well known in the art, such as described in the paper entitled "Learning and Revising 
User Profiles: The identification of Interesting Web Sites" by Pazzani, M. and Billsus, 

20 D., Machine Learning, 27, 3 13-33 1 , 1997. Another known method is described in the 
paper entitled "An Evaluation of statistical approaches to text categorization", by 
Yiming Yang, Journal of Information Retrieval, 1999, Vol 1, No. 1/2, pp 67-88. 

The linguistic representation and the list of topics is included in a 
representation of the content. The content along with the representation of the content 
25 is stored in a database on content server 210, and then transmitted to the requesting 
server, such as VIS 204 or personalization server 212. Control then passes to block 
602 to wait for another request for information. 

Referring now to Figs. 2 and 7, Fig. 7 shows a block diagram of components 
included in one embodiment of mobile audio device 208 including communication 
30 interface 700 and audio interface 702. Mobile audio device 208 receives audio input 
signals through microphone 704 from a user, processes user input signals as required 
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through analog to digital converter 706 and compression/encryption unit 708, and 
transmits processed user input signal 710 to communication interface 700. When 
conventional telephone system 218 is used, data is transferred via modem 712. 
Mobile audio device 208 also receives data signal 714 representing responsive 
5 information from communication interface 700 and processes it in audio interface 702 
to generate one or more audio output signals 716, 718, 720, 722, 723 that are 
transmitted to corresponding audio output devices including, for example, signal line 
724 direct-wired to car radio 726, wireless short-range radio 728 that broadcasts to car 
radio 726 on a selected channel, speaker 730, headphones 732, or cassette adapter 
10 733, respectively. 

Audio interface 702 exchanges input and output data signals with wireless 
communication network 202 via communication interface 700. Wireless 
communication network 202 may be one or a combination of any known wireless 
communication systems such as a satellite communication network or a cellular 
15 communication network that provides a communication link between VIS 204 and 
mobile audio device 208. 

Audio interface 702 includes audio converter 734, which receives from 
communication interface 700 through input buffer 736 information responsive to a 
user's request. The information responsive to the user's request may be specific 

20 information requested by the user, or it may be information that should be presented 
to the user, such as error or status messages, even though it was not specifically 
requested. Input buffer 736 is used to store the information until audio converter 734 
is ready to process it, thereby improving the continuity of the audio transmission to 
the user. Additionally, input buffer 736 allows the information to be stored when the 

25 user interrupts playback, such as by issuing a pause command. 

When the information received is stored in a compressed format, it is routed 
through decryption/decompression unit 738 before being sent to audio converter 734. 
Audio converter 734 converts the responsive information to audio signals 716, 718, 
720, 722, 723 for output to a respective audio output device 724, 726, 728, 730, 732, 
30 733. Thus, in addition to car stereos, the present invention may be utilized to deliver 
responsive information using many types of devices that include a built-in speaker 
- 19- 

685913 v2 



Attorney Docket No.: M-9477 US 



730 and/or headphones 732, including cellular telephones and other personal 
communication devices. Further, a combination of output devices may also be used, 
such as a cellular telephone that is configured to deliver audio signals to car radio 726, 
headphones 732, and/or speaker 730. 

5 In one embodiment, mobile audio device 208 includes one or more data 

processors 740, such as microprocessor 740, that executes software instructions to 
perform a variety of tasks including controlling transmission and reception of data 
messages and converting data messages to desired formats. The data processing 
associated with mobile audio device 208 may additionally be divided among several 
10 components having a dedicated data processor and program instructions to perform 
the tasks required of the component. Examples of components in mobile audio device 
208 that may include a data processor are decryption/decompression unit 738, input 
buffer 736, audio converter 734, analog to digital (A/D) converter 706, and 
compression unit 708. 

15 In another embodiment, mobile audio device 208 is a standalone device that 

may be located in the mobile vehicle or machine, or at a stationary location with the 
ability to transmit audio output signals 716, 718, 720, 722, 723 to one or more audio 
output devices 724, 726, 728, 730, 732, 734. Alternatively, mobile audio device 208 
may be incorporated in other components of network browser system 200 such as car 

20 radio 726, cellular telephone 220, wireless communication system 202, or VIS 204. 

In another embodiment, control switches 742, such as buttons and dials, are 
provided to allow the user to enter browser navigation commands and browser control 
selections. Control switch selections are converted to information requests or browser 
controls by program instructions in data processor 740. 

25 Wireless data that is transmitted to mobile audio device 208 may be in one of 

several formats depending on the transmission protocol being utilized. These formats 
include, but are not limited to, circuit-switched voice 746, circuit-switched data 748, 
and packet/cell-switched data 740. Circuit-switched voice 746 and circuit switched 
data 748 are transmitted using a circuit switching technique where a circuit between 

30 the calling and called stations is physically established on demand, for the exclusive 
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use by the two stations, until the connection is released. A packet is a group of bits 
switched as a unit for transmission over a shared network and is the basic unit of 
transmission in a packet-switched network. Packet-switched data 740 is transmitted 
using a transmission protocol in which data is segmented into packets that can be 
5 individually addressed and routed through the network, possibly using several 
different routes. The sequence of the packets is maintained and the destination 
established by the exchange of control information, contained in the packets, between 
the sending terminal and the network before the transmission starts. The receiving- 
end node determines that all packets are received and in the proper sequence before 

10 forwarding the reassembled message to the addressee. Packet switching allows 
facility sharing by many users. Packets can be routed individually over the best 
available network connection in a packet switching network, and reassembled to form 
a complete message at the destination. Control information is carried in the packet, 
along with the data, to provide for addressing sequence, flow control, and error 

15 control at each of several protocol levels. A packet can be of fixed or variable length, 
but usually has a specified maximum length of 1024 bits. Cell switched data is 
similar to packet-switched data, except it is transmitted using a different transmission 
protocol. 

For circuit-switched voice 746, VIS 204 replays the responsive information 
20 directly when the information is in pre-recorded audio format. When the information 
is in text format, VIS 204 converts the text to a speech format, based on the 
requirements of the particular audio output device. VIS 204 is capable of converting 
a variety of different text formats to a variety of different audio formats. The 
formatted information is transmitted to mobile audio device 208, which includes one 
25 or more data processors 740 that perform the required processing to format the 
information for transmission to audio converter 734. Audio converter 734 also 
includes a data processor for processing the information for output to the audio output 
device. 



Circuit- switched data 748 is sent to mobile audio device 208 either as 
30 compressed digital audio data or as digital data representing text. Compressed digital 
data is transmitted to input buffer 736, and converted to a decompressed format by 
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decryption/decompression unit 738. Audio converter 734 converts the decompressed 
information to one or more audio output signals 716, 718, 720, 722, 723 for output to 
one or more audio output devices 724, 726, 728, 730, 732, 734. 

For packet-switched and cell-switched data, the information is transmitted 
5 similar to the transmission of circuit-switched data, except that a packet-switched or 
cell-switched data transmission protocol is used between content server 210, VIS 204, 
and wireless communication network 202. Packet-switched and cell-switched data is 
most likely to be used between content server 210, VIS 204, and wireless 
communication network 202 in the present invention using wireless communication 
10 networks 202 currently available. 

Alternatively, or in addition to wireless data, the responsive information may 
be transmitted via conventional telephone system 218 through telephone line 752. 
Another alternative is providing responsive information from a disk on disk drive 754. 
The information on disk drive 754 may have been stored during a previous session, 
15 and is thus available for playback at a later time by the user. 

Notably, radio 726 may be any type of a radio capable of being used in a 
mobile vehicle, and the present invention is particularly suitable for use with a car's 
existing built-in stereo system. One embodiment of the present invention utilizes a 
short-range AM/FM radio transmitter. In this embodiment wireless communication 

20 network 202 communicates with mobile audio device 208 using a cellular or satellite 
network, and mobile audio device 208 broadcasts the information using short-range 
AM/FM signals to a pre-selected AM/FM frequency that is received by car radio 726 
(e.g., a built-in car radio). Another embodiment of the present invention provides 
signals to radio 726 from audio converter 734 via a direct electrical connection to 

25 standard input plugs such as CD, FM or line-in. Still another embodiment of the 

present invention includes an adapter device, such as cassette adapter , that is operable 
to receive signals from car radio 726 and output them to a recording device for storing 
the responsive information on a storage medium. The responsive information may 
then be played back at the user's convenience. 
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Content aggregation server 210 includes one or more computer systems that 
aggregate information retrieved from remote servers 214, as requested by the user. 
The information is stored as compressed or uncompressed digital voice format, text 
format, or any other applicable format that may be used to represent the information. 
5 Servers 210, 212, 214 are connected to information network 216 via a high-speed 
connection, and can quickly retrieve information from one of servers 214 if the 
information requested is not found on local content aggregation server 210. 

Personalization server 212 includes one or more computer systems that are 
used to store personal information about users. One embodiment of the present 

10 invention allows the user to customize the information broadcast from the wireless 
network over the car radio or other audio output device. The user may also customize 
menus and select options for presenting the responsive information, or the user may 
alternatively use a default set of selections that are available to all users. Personal 
information may include, but is not limited to, user name, password, information 

15 preferences such as, for example, a list of stocks for which current stock market price 
is desired, and news information sources to utilize. The user may enter preferences 
using microphone 704, conventional telephone system 218, cellular telephone system 
220, or workstation 222 connected to personalization server 212 through information 
network 216. 

20 VIS 204 is operable to recognize commands from a user's speech for 

interaction with content aggregation server 210, personalization server 212, as well as 
remote servers 214 through information network 216. An example of a voice 
recognition system 800 suitable for use with the present invention is shown in Fig. 8. 
Such a voice recognition system may be used for a variety of purposes including 

25 inputting data and commands to an information network browser program or 

electronic mail program, and controlling operation of a device. Voice recognition 
system 800 may be tailored to a specific use and therefore may be programmed to 
recognize and respond to certain words or phrases as being valid system commands or 
input. Such words and phrases are typically determined and implemented before 

30 voice recognition system 800 is deployed; however, voice recognition system 800 

may also have the capability to adapt to changed conditions, such as, for example, to 
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dynamically adjust to a change or substitution of hardware components, including 
switching between wireless telephone 802, microphone 804, and conventional 
telephone system 806 for input. 

Referring now to Figs. 2 and 8, VIS 204 is implemented on a data processing 
5 system, which may be one of several different types of data processing systems 

including, for example, mainframes, minicomputers, workstations, servers, personal 
computers, Internet terminals, laptop computers, palmtop computers, and embedded 
systems. The data processing system may be one of many workstations connected to 
a network such as a local area network (LAN), a wide area network (WAN), and/or 
10 information network 216. 

A user's voice is input to a speech input device, such as wireless telephone 
802, microphone 804, or conventional telephone 806, which, depending on the device, 
generates an analog or a digital input signal representing the acoustic wave input of 
the user's natural speech. The analog input signals are coded as speech data using an 

15 appropriate speech input processor 808, 810. Speech data can be coded as, for 
example, Adaptive Differential Pulse Coded Modulation (ADPCM) using 
commercially available modulation devices. In addition, or alternatively, speech data 
may be transferred coded as Linear Predictive Coding (LPC) parameters or other 
parameters achieving low bit rates (e.g. 4.8 Kbits/second), or using a compressed 

20 format, such as, for example, MPEG 1 layer 3 (MP3). 

For an input device that provides an analog signal, speech input processors 
808, 810 convert the analog signal to digital samples of the analog signal at a 
prescribed rate, and transmit the digital samples as electrical signals representing the 
speaker's voice. For an input device that provides signals that are already in digital 

25 format, such as wireless telephone 802, the voice signals are already sampled at 

regular, short intervals, to create a digital representation of the original voice wave. 
Speech input processor 812 next processes the digitized voice, resulting in a 
compressed representation of the digital voice signal. The signals representing the 
speaker's voice are input to VIS 204, which processes and analyzes the digital signals. 

30 It is important to note that VIS 204 may receive voice input in analog format, in 

which case it performs standard voice recognition. In other implementations, VIS 204 
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may receive the voice in a compressed/encrypted digital format, in which case VIS 
204 would have to decrypt, decompress, and convert the signal to an analog signal 
before processing voice recognition. 

During operation, VIS 204 utilizes speech analysis unit 820, which includes 
5 program instructions that may be embodied in one or more executable modules that 
are executed as required. The program instructions are commercially available and 
may perform several processing functions including echo cancellation 822, signal 
processing 824, barge-in 826, speech recognition 828, and speech generation 830. 

Echo cancellation 822 removes echoes caused by delays (e.g., in a 
10 telecommunications network) or reflections from acoustic waves in the immediate 
environment. This provides higher quality speech for recognition and processing by 
VIS 204. 



Barge-in 826 may detect speech received at speech input coders 808, 810. In 
one embodiment, barge-in 826 may distinguish human speech from ambient 
15 background noise. Barge-in 826 is optional, and therefore, may not be present in 
every implementation. 

Signal processing 824 performs signal processing operations which, among 
other things, may include transforming speech data received in time domain format 
(such as ADPCM) into a series of feature parameters such as, for example, standard 

20 cepstral coefficients, Fourier coefficients, LPC coefficients, or other parameters in the 
time or frequency domain. For example, in one embodiment, signal processing 
component 824 may produce a twelve-dimensional vector of cepstral coefficients 
every 10 milliseconds to model speech input data. Software for implementing signal 
processing 824 is commercially available from line card manufacturers and automated 

25 speech recognition (ASR) suppliers. 

Speech recognition 828 recognizes vocalized speech input from speech input 
signals. As shown, speech recognition 828 may comprise an acoustic model 
component and a grammar component. The acoustic model component may comprise 
one or more reference voice templates which store previous enunciations, or acoustic 
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models, of certain words or phrases by particular users. Acoustic model component 
recognizes the speech of the same users based upon their previous enunciations stored 
in the reference voice templates. The grammar component may specify certain words, 
phrases, and/or sentences which are to be recognized if spoken by a user. Recognition 
5 grammars for the grammar component can be defined in a grammar definition 
language (GDL), and the recognition grammars specified in GDL can then be 
automatically translated into machine executable grammars. In one embodiment, the 
grammar component may also perform natural language processing. Hardware and/or 
software for implementing recognition grammars is commercially available from a 
10 number of vendors and can typically be modified for particular applications. 

Speech generation 830 generates speech data representing responses to 
information requests, prompts, or other messages, which is intended to be heard by a 
user. Speech generation 830 comprises a text-to-speech (TTS) component which 
synthesizes human speech by "speaking" text, such as that contained in a textual 
15 HTML document. The text-to-speech component may utilize one or more synthetic 
speech mark-up files for determining, or containing, the speech to be synthesized. 
Software for implementing the text-to-speech component is commercially available 
from a number of companies. 

Fig. 9 shows another embodiment of the present invention of a system 900 
20 with position-keeping and voice recognition and feedback capability for browsing an 
information network. System 900 includes components similar to the embodiment 
shown in Fig. 2, with the addition of location server 902 and position-keeping 
capabilities to provide the location of mobile audio device 904. The position-keeping 
capabilities may be provided by one or more of several known systems for supplying 
25 the location of a movable object. Such systems include, but are not limited to, global 
positioning systems (GPS), inertial navigation systems, triangulation systems using 
signals from wireless communication network 906, and dead reckoning navigation 
systems. The position-keeping system may provide coordinates of mobile audio 
device 904 in any system desired including Cartesian (x, y, z) coordinates with 
30 respect to a known reference point, or latitude/longitude/altitude/heading with respect 
to the known earth navigation system. 
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The position-keeping system, or components of the position-keeping system, 
is included in one or more of any appropriate components comprising the present 
invention. For example, a GPS receiver may be included in mobile audio device 904 
to receive the coordinates of mobile audio device 904 from a GPS satellite network as 
the mobile audio device 904 moves from location to location. The particular 
components included in any given positioning-keeping system and their function will 
dictate the most appropriate component in the present invention in which to include a 
particular component of the position-keeping system. 

Location server 902 communicates with wireless communication network 906, 
content server 908, and personalization server 910. The coordinates of mobile audio 
device 904 are transmitted to location server 902 via wireless communication network 
906. Location server 902 may then transmit location information to content server 
908 and/or personalization server 910 to be used in providing a wide variety of 
personalized location-specific information to the user. For example, a user having an 
automobile equipped with mobile audio device 904 may personalize his or her profile 
so that the names of restaurants within a 5-mile radius of his or her specific location 
are provided when requesting locations of local restaurants. Another example is to 
use the location information to provide driving instructions to a requested destination. 
Such a system may be integrated with position-keeping and navigation systems 
available in some models of automobiles. It will be apparent to one skilled in the art 
that the location-specific information may be used to provide virtually any type of 
location-related information to the user. 

In another embodiment, mobile audio device 904 includes capability to detect 
and compensate for data transmission errors in wireless communication network 906. 
Such capability utilizes location information to determine when mobile audio device 
904 is coming near an area covered by wireless communication network 906 where 
there is a high incidence of data loss due to propagation errors caused by such factors 
as atmospheric effects, the presence of earth bulge, and the effects of trees, buildings, 
and hills which exist in, or close to, the transmission path. This information is stored 
in a database, and the error detection/compensation routine compares the location of 
the mobile audio device 904 to error information in the database. When mobile audio 
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device 904 is likely to experience a data loss rate that is higher than a pre-selected 
value, one of several options may be taken including informing the user of the 
likelihood of errors or gaps in the information, asking the user if they would prefer to 
wait for the information until transmission of the data will be more reliable, or 
5 buffering a greater than normal amount of information to be able to continue 
undisrupted output until the connection is re-established. 

One skilled in the art will recognize that the functions performed by location 
server 902 may be integrated in another server connected to information network 912, 
such as content server 908, thereby eliminating the need for a separate server for 
10 location server 902. 

Fig. 10 shows a block diagram of an embodiment of mobile audio device 904 
with location processor 1002. Mobile audio device 904 corresponds to the system 
900 with position-keeping and voice recognition and feedback capability for browsing 
an information network in Fig. 9. Location processor 1002 may be a dedicated data 
15 processor such as an application-specific integrated circuit (ASIC) designed 

specifically to handle location data, or the location data may be processed in another 
data processor that is also used for other purposes in mobile audio device 904. 

Fig. 1 1 shows a schematic diagram of one embodiment of the present 
invention for mobile audio device 1100 that is designed as an adapter to a mobile 

20 telephone. Mobile audio device 1 100 may receive power through adapter plug 1 102 
when adapter plug 1 102 is plugged into an automobile's cigarette lighter receptacle. 
Alternatively, power may be supplied by the mobile telephone's battery through 
voltage regulators 1104 and 1106 at 5 volts and 3.3 volts, respectively. When adapter 
plug 1102 is plugged into a cigarette lighter receptacle, battery charger 1108 provides 

25 recharging power from the automobile to the mobile telephone's battery back. A 
modem link is established between mobile audio device 1100 and the mobile 
telephone through connector 11 10, which may be one of any suitable type of interface 
connectors known in the art for transmitting data and power signals, such as RS232 
data communication at 115.2k baud using TCP/IP connection protocol. Battery 

30 charger 1 108 may be eliminated when mobile audio device 1 100 is used with a 
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mobile telephone that includes a 12 volt adapter and power is provided over the 
modem cable to mobile audio device 1 100. 

The mobile telephone establishes a communication line with information 
network 912 (Fig. 9) through wireless communication network 202 (Fig. 7). 
5 Transceiver 1112 provides two-way communication between data signals from 

connector 1110 and digital signal processor (DSP) 1 1 14, such data including requests 
for information from DSP 1 1 14, and information responsive to requested information 
from information network 912. DSP 1114 executes software instructions to perform a 
variety of tasks including controlling transmission and reception of data messages and 

10 converting data messages to desired formats. DSP 1114 may also be used to perform 
speech recognition and voice decompression functions. Memory devices, such as 
static ram memory device 1116 and flash memory device 1118 are coupled to DSP 
1 1 14 to provide data storage. DSP 1 1 14 is also coupled to receive input from push 
button control switch 1120 which may be used in one or more ways to control 

15 operation of mobile audio device 1 100. For example, a single quick push of switch 
1120 causes the telephone to dial a pre-programmed phone number for establishing 
communication with information network 912. A longer, several second push of 
switch 1 120 causes mobile audio device 1 100 to enter a configuration mode to allow a 
user to set the FM output frequency and/or the pre-programmed telephone number for 

20 accessing information network 912. The numeric information is entered via the 
telephone's numeric keypad. Switch 1120 may also be used to put mobile audio 
device 1100 into a voice command mode, allowing hands-free selection and activation 
of pre-programmed information requests, audio volume control, and FM channel 
selection. Light emitting diode (LED) 1122 provides one or more visual indicators of 

25 mobile audio device's 1 100 operational status. Note that other control switches may 
be used in addition or instead of switch 1 120 to control operation of mobile audio 
device 1100. Alternatively, mobile audio device 1100 could operate without switch 
1 120 by operating in a continuous speech recognition mode when powered on. 

Audio coder/decoder (codec) 1 124 is coupled for two-way communication 
30 with DSP 1 1 14. Codec 1 124 also receives input from the user through the 

combination of microphone 1 126 and amplifier 1 128, and provides an audio output 
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signal, such as output signals 716, 718, 720, 722, 723 in Fig. 7, to the audio output 
device, shown as a short-range FM transmitter 1130. Codec 1124 performs data 
compression, encryption, decompression, and decryption, and also includes an input 
buffer for storing data. 

5 The embodiment of mobile audio device 1 100 shown in Fig. 1 may be 

packaged in a separate casing that is small enough to be hand-held or carried in a 
shirt pocket. The cigarette plug cable, the modem cable, and the microphone cable 
may be fixedly or removably attached to the casing. In one embodiment, mobile 
audio device 1 100 operates under section 15.239 of the Federal Communication 
10 Commission (FCC) regulations, which provides for unlicensed operation in the FM 
broadcast band. 

While the invention has been described with respect to the embodiments and 
variations set forth above, these embodiments and variations are illustrative and the 
invention is not to be considered limited in scope to these embodiments and 

15 variations. For example, transmitting audio output signals 716, 718, 720, 722, 723 
may be performed by VIS 204, which takes the responsive information and converts it 
to voice when text-to-speech conversion is required. Alternatively, when mobile 
audio device 208 includes text-to-speech technology, mobile audio device 208 
communicates directly with content server 210, effectively bypassing VIS 204. 

20 Accordingly, various other embodiments and modifications and improvements not 
described herein may be within the spirit and scope of the present invention, as 
defined by the following claims. 
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WHAT IS CLAIMED IS: 



1 1. A mobile browser system with adaptive personalization and audio feedback 

2 capability for retrieving information from an information network, the information 

3 network comprising a plurality of network servers, the browser system comprising: 

4 a wireless communication interface operable to transmit data to one or more of 

5 the plurality of network servers, to receive user input, and to receive 

6 data from one or more of the plurality of network servers, wherein the 

7 data transmitted to the one or more of the plurality of network servers 

8 includes a request for information, and the data received from the one 

9 or more of the plurality of network servers includes information 

10 responsive to the request; 

11 an audio interface operable to receive data from the wireless communication 

12 interface; and 

13 an adaptive personalization module operable to monitor the user input during 

14 one or more previous sessions with the browser system, and to 

1 5 determine the order for presenting the requested information based on 

16 previous user input. 

1 2. The browser system, as set forth in claim 1 , wherein the adaptive 

2 personalization module is further operable to update a user' s model based on the 

3 previous user input and the user' s model is used to determine the order for presenting 

4 the requested information. 

1 3. The browser system, as set forth in claim 1 , wherein the adaptive 

2 personalization module is further operable to update a user' s model based on whether 

3 the user input a command to skip playback of the requested information. 

1 4. The browser system, as set forth in claim I, wherein the adaptive 

2 personalization module is further operable to update a user' s model based on whether 

3 the user input a command to fast-forward or rewind playback of the requested 

4 information. 
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1 5. The browser system, as set forth in claim 1, wherein the adaptive 

2 personalization module is further operable to update a user's model based on whether 

3 the user requested more detail on the requested information. 

1 6. The browser system, as set forth in claim 1, wherein the adaptive 

2 personalization module is further operable to generate a representation of each piece 

3 of content in the requested information, and the order of presentation of the requested 

4 information is determined based on the user's model and the representation. 

1 7. The browser system, as set forth in claim 1 wherein the adaptive 

2 personalization module is further operable to determine whether the requested 

3 information is redundant compared to information presented during a previous 

4 session. 

1 8. The browser system, as set forth in claim 1 wherein the adaptive 

2 personalization module is further operable to determine whether a piece of content in 

3 the requested information is redundant compared to one or more other pieces of 

4 content in the requested information. 

1 9. The browser system, as set forth in claim 6 wherein the adaptive 

2 personalization module is further operable to convert the responsive information from 

3 a text format to an audio format, and the representation includes the frequency with 

4 which each word occurs in each piece of content. 

1 10. The browser system, as set forth in claim 6 wherein the adaptive 

2 personalization module is further operable to convert the responsive information from 

3 an audio format to a text format, and the representation includes the frequency with 

4 which each word occurs in each piece of content. 

1 11. The browser system, as set forth in claim 1, further comprising a user 

2 interface operable to allow the user to generate and modify a playlist, wherein the 

3 playlist is included in the user' s model. 
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1 12. The browser system, as set forth in claim 1 1 , wherein the user interface is 

2 a graphical user interface. 

1 13. The browser system, as set forth in claim 11, wherein the user interface is 

2 an audio interface. 



1 14. The browser system, as set forth in claim 1 1, wherein the user interface is 

2 a telephone interface. 

1 15. The browser system, as set forth in claim 1 1, wherein the user interface is 

2 a wireless telephone interface. 

1 16. The browser system, as set forth in claim 1, wherein the adaptive 

2 personalization module is further operable to generate and modify a user' s playlist. 

1 17. The browser system, as set forth in claim 1, further comprising: 

2 a mobile audio device having an audio converter, the audio converter being 

3 operable to receive the information responsive to the request, the audio 

4 converter being further operable to convert the responsive information 

5 to an audio signal for output to an audio output device, wherein the 

6 audio converter outputs the audio signal to a short-range wireless 

7 radio, the short-range wireless radio being operable to broadcast the 

8 audio signal to a channel on a car radio. 

1 1 8. A mobile information network browser device with feedback capability 

2 for retrieving information from an information network, the information network 

3 comprising a plurality of network servers, the browser device comprising: 

4 a communication interface operable to transmit a request for information to a 

5 network server, and to receive data responsive to the request from the 

6 network server; 

7 a mobile audio device operable to transmit the request for information to the 

8 communication interface and to receive data responsive to the request 

9 from the communication interface, the mobile audio device being 
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10 further operable to receive input from a user, to convert the input to a 

1 1 digital signal, and to transmit the digital signal to the communication 

12 interface, the mobile audio device being further operable to receive the 

13 data responsive to the request from the communication interface, and 

14 to convert the data to an audio signal for output to an audio output 

15 device; and 

16 an adaptive personalization module operable to monitor the user input during 

17 one or more previous sessions with the browser device, and to 

1 8 determine the order for presenting the requested information based on 

19 previous user input. 

1 19. The browser device, as set forth in claim 18, further comprising: 

2 a voice interaction system operable to recognize commands from a user's 

3 speech input for interaction with the browser device including the 

4 request for information. 

1 20. The browser device, as set forth in claim 18, wherein the adaptive 

2 personalization module is further operable to update a user's model based on the 

3 previous user input and the user' s model is used to determine the order for presenting 

4 the requested information. 

1 21. The browser device, as set forth in claim 18, wherein the adaptive 

2 personalization module is further operable to update a user' s model based on whether 

3 the user input a command to skip playback of the requested information. 

1 22. The browser device, as set forth in claim 18, wherein the adaptive 

2 personalization module is further operable to update a user's model based on whether 

3 the user input a command to fast-forward or rewind playback of the requested 

4 information. 

1 23. The browser device, as set forth in claim 18, wherein the adaptive 

2 personalization module is further operable to update a user's model based on whether 

3 the user requested more detail on the requested information. 
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1 24. The browser device, as set forth in claim 18, wherein the adaptive 

2 personalization module is further operable to generate a representation of each piece 

3 of content in the requested information, and the order of presentation of the requested 

4 information is determined based on the user' s model and the representation. 

1 25. The browser device, as set forth in claim 24, wherein the adaptive 

2 personalization module is further operable to convert the responsive information from 

3 a text format to an audio format, and the representation includes the frequency with 

4 which each word occurs in each piece of content. 

1 26. The browser device, as set forth in claim 24, wherein the adaptive 

2 personalization module is further operable to convert the responsive information from 

3 an audio format to a text format, and the representation includes the frequency with 

4 which each word occurs in each piece of content. 

1 27. The browser device, as set forth in claim 18, wherein the adaptive 

2 personalization module is further operable to determine whether the requested 

3 information is redundant compared to information presented during a previous 

4 session. 

1 28. The browser device, as set forth in claim 18 wherein the adaptive 

2 personalization module is further operable to determine whether a piece of content in 

3 the requested information is redundant compared to one or more other pieces of 

4 content in the requested information. 

1 29. The browser device, as set forth in claim 18, further comprising a user 

2 interface operable to allow the user to generate and modify a playlist, wherein the 

3 playlist is included in the user' s model. 

1 30. The browser device, as set forth in claim 29, wherein the user interface is 

2 a graphical user interface. 
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1 31. The browser device, as set forth in claim 29, wherein the user interface is 

2 an audio interface. 

1 32. The browser device, as set forth in claim 29, wherein the user interface is 

2 a telephone interface. 

1 33. The browser device, as set forth in claim 29, wherein the user interface is 

2 a wireless telephone interface. 

1 34. The browser device, as set forth in claim 29, wherein the adaptive 

2 personalization module is further operable to generate and modify a user's playlist. 

1 35. A mobile information network browser device with audio feedback 

2 capability, the information network comprising a plurality of network servers, the 

3 browser device comprising: 

4 a communication interface operable to receive data from at least one of the 

5 network servers; 

6 a mobile audio device operable to receive the data from the communication 

7 interface, the mobile audio device being further operable to convert the 

8 data to an audio signal for output to a car radio; and 

9 an adaptive personalization module operable to monitor the user input during 

10 one or more previous sessions with the browser device, and to 

1 1 determine the order for presenting the requested information based on 

12 previous user input. 

1 36. The browser device, as set forth in claim 35, wherein operation of the 

2 mobile audio device is controlled with voice commands. 

1 37. The browser device, as set forth in claim 35, wherein the communication 

2 interface is operable to receive the data from a wireless communication network. 

1 38. The browser device, as set forth in claim 35, wherein the adaptive 

2 personalization module is further operable to update a user' s model based on the 
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3 previous user input and the user's model is used to determine the order for presenting 

4 the requested information. 



1 39. The browser device, as set forth in claim 35, wherein the adaptive 

2 personalization module is further operable to generate a representation of each piece 

3 of content in the requested information, and the order of presentation of the requested 

4 information is determined based on the user' s model and the representation. 

1 40. The browser device, as set forth in claim 35, wherein the adaptive 

2 personalization module is further operable to generate and modify a user's playlist. 

1 41. The browser device, as set forth in claim 40, wherein the adaptive 

2 personalization module is further operable to convert the responsive information from 

3 a text format to an audio format, and the representation includes the frequency with 

4 which each word occurs in each piece of content. 



1 42. The browser device, as set forth in claim 40, wherein the adaptive 

2 personalization module is further operable to convert the responsive information from 

3 an audio format to a text format, and the representation includes the frequency with 

4 which each word occurs in each piece of content. 



1 43. A mobile information network browser device with audio feedback 

2 capability, the information network comprising a plurality of network servers, the 

3 browser device comprising: 

4 a communication interface operable to receive data from at least one of the 

5 network servers; 

6 a mobile audio device operable to receive the data from the communication 

7 interface, the mobile audio device being further operable to convert the 

8 data to an audio signal for output to a telephone; and 

9 an adaptive personalization module operable to monitor the user input during 

10 one or more previous sessions with the browser device, and to 

1 1 determine the order for presenting the requested information based on 

12 previous user input. 
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1 44. The browser device, as set forth in claim 43, wherein operation of the 

2 mobile audio device is controlled with voice commands. 

1 45. The browser device, as set forth in claim 43, wherein the communication 

2 interface is operable to receive the data from a wireless communication network. 

1 46. The browser device, as set forth in claim 43, wherein the adaptive 

2 personalization module is further operable to update a user' s model based on the 

3 previous user input and the user's model is used to determine the order for presenting 

4 the requested information. 

1 47. The browser device, as set forth in claim 43, wherein the adaptive 

2 personalization module is further operable to generate a representation of each piece 

3 of content in the requested information, and the order of presentation of the requested 

4 information is determined based on the user' s model and the representation. 

1 48. The browser device, as set forth in claim 47, wherein the adaptive 

2 personalization module is further operable to convert the responsive information from 

3 a text format to an audio format, and the representation includes the frequency with 

4 which each word occurs in each piece of content. 



1 49. The browser device, as set forth in claim 47, wherein the adaptive 

2 personalization module is further operable to convert the responsive information from 

3 an audio format to a text format, and the representation includes the frequency with 

4 which each word occurs in each piece of content. 



1 50. A method of browsing an information network via a wireless 

2 communication network and receiving responsive information in audio format using a 

3 mobile audio device, the method comprising: 

4 transmitting input from a user via the wireless communication network to a 

5 data processor; 

6 processing the input to determine when the user enters a valid browsing 

7 command; 
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8 transmitting the browsing command to a server on the information network; 

9 receiving the responsive information from the server; 

10 adaptively determining the order for presenting the responsive information 

1 1 based on user input during one or more previous sessions with the 

12 mobile audio device; 

13 formatting the responsive information in audio format; 

14 transmitting the formatted audio information to the mobile audio device via 

15 the wireless communication network; 

16 generating an audio output signal in the mobile audio device; and 

17 transmitting the audio output signal to an audio output device. 

1 51. The method, as set forth in claim 49, further comprising: 

2 recognizing commands from a user' s speech input for interaction with the 

3 mobile audio device including the browsing command. 

1 52. The method, as set forth in claim 49, wherein adaptively determining the 

2 order for presenting the responsive information includes updating a user' s model 

3 based on the previous user input and determining the order for presenting the 

4 responsive information based on the user' s model. 

1 53. The method, as set forth in claim 49, wherein adaptively determining the 

2 order for presenting the responsive information includes updating a user's model 

3 based on whether the user input a command to skip playback of the responsive 

4 information. 



1 54. The method, as set forth in claim 49, wherein adaptively determining the 

2 order for presenting the responsive information includes updating a user's model 

3 based on whether the user input a command to fast-forward or rewind playback of the 

4 responsive information. 

1 55. The method, as set forth in claim 49, wherein adaptively determining the 

2 order for presenting the responsive information includes updating a user's model 

3 based on whether the user requested more detail on the responsive information. 
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1 56. The method, as set forth in claim 55, wherein adaptively determining the 

2 order for presenting the responsive information includes generating a representation 

3 of each piece of content in the responsive information, and the order of presentation 

4 of the responsive information is determined based on the user's model and the 

5 representation. 

1 57. The method, as set forth in claim 49 wherein adaptively determining the 

2 order for presenting the responsive information includes converting the responsive 

3 information from a text format to an audio format, and the representation includes the 

4 frequency with which each word occurs in each piece of content. 



1 58. The method, as set forth in claim 49 wherein adaptively determining the 

2 order for presenting the responsive information includes converting the responsive 

3 information from an audio format to a text format, and the representation includes the 

4 frequency with which each word occurs in each piece of content. 

1 59. The method of claim 49 wherein the mobile audio device includes at least 

2 a portion of a position-keeping system, the method further comprising: 

3 providing the position of the mobile audio device to the information network 

4 via the wireless communication network, wherein the responsive 

5 information is based on the location of the mobile audio device. 

1 60. The method, as set forth in claim 49, further comprising determining 

2 whether the requested information is redundant compared to information presented 

3 during a previous session, and limiting the amount of redundant information that is 

4 presented to the user. 

1 61. The method, as set forth in claim 49, further comprising determining 

2 whether a piece of content in the requested information is redundant compared to one 

3 or more other pieces of content in the requested information, and limiting the amount 

4 of redundant information that is presented to the user. 
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1 62. The browser system, as set forth in claim 49, wherein adaptively 

2 determining the order for presenting the responsive information includes modifying a 

3 user's play list. 
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PORTABLE BROWSER DEVICE WITH ADAPTIVE PERSONALIZATION 
CAPABILITY 

Claude-Nicolas Fiechter 
5 Amir Ben-Efraim 

Tea Hea Nahm 
David Hudson 



Abstract of the Disclosure 



A mobile information network browser device with audio feedback and 
10 adaptive personalization capability that is capable of transmitting a request for 

information via a wireless communication interface from one or more servers in an 
information network. The browser device further includes an audio interface capable 
of receiving data from the wireless communication interface that is responsive to the 
request for information. The browser device interfaces with a wireless 
15 communication network so that it may be used in a mobile vehicle, such as an 
automobile. The order in which individual pieces of content in the requested 
information is presented to the user is modified based on indicators of the user's 
interest in a topic during previous sessions. Such indicators can include whether the 
user input a command to skip, fast-forward, rewind, or request more detail about a 
20 category, subcategory, or topic of information. The adaptive personalization 
capability can also prevent redundant content from being presented. 
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DECLARATION FOR PATENT APPLICATION 
AND POWER OF ATTORNEY 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below adjacent to my name. 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, 
first and joint inventor (if plural names are listed below) of subject matter (process, machine, 
manufacture, or composition of matter, or an improvement thereof) which is claimed and for which a 
patent is sought by way of the application entitled 

Portable Browser Device With Adaptive Personalization Capability 

which (check) O is attached hereto. 

I I and is amended by the Preliminary Amendment attached hereto. 

I I was filed on as Application Serial No. 

I I and was amended on (if applicable). 

I hereby state that I have reviewed and understand the contents of the above identified specification, 
including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information, which is material to patentability as defined in 
Title 37, Code of Federal Regulations, § 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, § 119(a)-(d) of any foreign 
application(s) for patent or inventor's certificate or any PCT international application(s) designating at 
least one country other than the United States of America listed below and have also identified below 
any foreign application(s) for patent or inventor's certificate or any PCT international application(s) 
designating at least one country other than the United States of America filed by me on the same 
subject matter having a filing date before that of the application(s) of which priority is claimed: 



Prior Foreign Application(s) 


Priority Claimed 


Number 


Country 


Day/Month/Year Filed 


Yes 


No 


N/A 






□ 


□ 



I hereby claim the benefit under Title 35, United States Code, § 1 19(e) of any United States 
provisional application(s) listed below: 



Provisional Application Number 


Filing Date 


N/A 





I hereby claim the benefit under Title 35, United States Code, § 120 of any United States 
application(s) or PCT international application(s) designating the United States of America listed 
below and, insofar as the subject matter of each of the claims of this application is not disclosed in the 
prior application(s) in the manner provided by the first paragraph of Title 35, United States Code, 
§ 112, 1 acknowledge the duty to disclose information, which is material to patentability as defined in 
Title 37, Code of Federal Regulations, § 1.56, which became available between the filing date of the 
prior application(s) and the national or PCT international filing date of this application: 



Application Serial No. 


Filing Date 


Status (patented, pending, abandoned) 


N/A 
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I hereby appoint the following practitioners to prosecute this application and to transact all business in 
the United States Patent and Trademark Office connected therewith: 



Customer Number 24251 



lllllllllll 



Please address all correspondence and telephone calls to: 

Mary Jo Bertani 
SKJERVEN MORRILL MacPHERSON LLP 

25 Metro Drive, Suite 700 
San Jose, California 95 1 1 0- 1 349 

Telephone: 512-794-3600 
Facsimile: 512-794-3601 

I declare that all statements made herein of my own knowledge are true, all statements made herein on 
information and belief are believed to be true, and all statements made herein are made with the 
knowledge that whoever, in any matter within the jurisdiction of the Patent and Trademark Office, 
knowingly and willfully falsifies, conceals, or covers up by any trick, scheme, or device a material 
fact, or makes any false, fictitious or fraudulent statements or representations, or makes or uses any 
false writing or document knowing the same to contain any false, fictitious or fraudulent statement or 
entry, shall be subject to the penalties including fine or imprisonment or both as set forth under 18 
U.S.C. 1001, and that violations of this paragraph may jeopardize the validity of the application or 
this document, or the validity or enforceability of any patent, trademark registration, or certificate 
resulting therefrom. 
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